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ABSTRACT 

We investigated a set of high-resolution (R ~ 45 000), high signal-to-noise (S/N ~ 70) quasar spectra to search for the signature of 
the so-called proximity effect in the Hi Lya forest. The sample consists of 40 bright quasars with redshifts in the range 2.1 < z < 4.7. 
Using the flux transmission statistic, we determined the redshift evolution of the H i effective optical depth in the Lyman forest between 
2SzS 4.5, finding good agreement with previous measurements based on smaller samples. We also see the previously reported dip in 
T cff (z) around redshift z ~ 3.3, but as the significance of that feature is only 2.6<x, we consider this detection tentative. Comparing the 
flux transmission near each quasar with what was expected from the overall trend of T cff (z), we clearly detect the proximity effect not 
only in the combined quasar sample, but also towards each individual line of sight at high significance, albeit with varying strength. 
We quantify this strength using a simple prescription based on a fiducial value for the intensity of the metagalactic UV background 
(UVB) radiation field at 1 Ryd, multiplied by a free parameter that varies from QSO to QSO. The observed proximity effect strength 
distribution (PESD) is asymmetric, with an extended tail towards values corresponding to a weak effect. We demonstrate that this is 
not simply an effect of gravitational clustering around quasars, as the same asymmetry is already present in the PESD predicted for 
purely Poissonian variance in the absorption lines. We present the results of running the same analysis on simulated quasar spectra 
generated by a simple Monte-Carlo code. Comparing the simulated PESD with observations, we argue that the standard method of 
determining the UVB intensity J vo by averaging over several lines of sight is heavily biased towards high values of J va because of 
the PESD asymmetry. Using instead the mode of the PESD provides an estimate of J va that is unbiased with respect to his effect. 
For our sample we get a modal value for the UVB intensity of log./ vo = -21.51 ± 0.15 (in units of ergcirT 2 s Hz~' sr ) for a 
median quasar redshift of 2.73. With J VB fixed we then corrected T cff near each quasar for local ionisation and estimated the amount of 
excess Hi absorption attributed to gravitational clustering. On scales of ~ 3 Mpc, only a small minority of quasars show substantial 
overdensities of up to a factor of a few in Tea ; these are exactly the objects with the weakest proximity effect signatures. After removing 
those quasars residing in overdense regions, we redetermined the UVB intensity using a hybrid approach of sample averaging and 
statistical correction for the PESD asymmetry bias, arriving at log J vo = -21.46^ ■\\. This is the most accurate measurement of J vo to 
date. We present a new diagnostic based on the shape and width of the PESD that strongly supports our conclusion that there is no 
systematic overdensity bias for the proximity effect. This additional diagnostic breaks the otherwise unavoidable degeneracy of the 
proximity effect between UVB and overdensity. We then applied our hybrid approach to estimate the redshift evolution of the UVB 
intensity and found tentative evidence of a mild decrease in log J VB with increasing redshift, by a factor of ~ 0.4 from z = 2 to z = 4. 
Our results are in excellent agreement with earlier predictions for the evolving UVB intensity, and they also agree well with other 
methods of estimating the UVB intensity. In particular, our measured UVB evolution is much slower than the change in quasar space 
densities between z = 4 and z = 2, supporting the notion of a substantial contribution of star-forming galaxies to the UVB at high 
redshift. 

Key words, diffuse radiation - intergalactic medium - quasars: absorptionlines 

1. Introduction by the metagalactic UV background (UVB) generated by 

TT . , , . „ , . , , , .. . „ , . the overall p opulation o f quasars an d star-forming galaxies 

High-resolution spectra of high-redshift, quasi-stellar objects (Ha ardt & Madau 19H iFardal et all EH Eaardt & Madau 

(QSOs) show a plethora of narrow absorption lines from yar- :2Q0l|), The UVB intensity at a given frequency is determined 

ious species along their lines of sight through the intergalac- fe ±Q evoM lation of uv sources , modified by cosmo- 

tic medium (IGM). Most absorption lines blueward of an Lya , kal sion and absorption (e.g. lDave et al.ll999h . It is im- 

emission line stem from the Lya transition of intervening m tQ determine the amplitude of the UVB and its spectral 

neufial hydrogen, giving r i se to the Ly a forest ( Sargent_etalJ shape as a function of redshift in order to constrain the relative 



1980; Weyma nn et aUl98l fc| Rauch | l998 ). High-resolution spec- contributions of s and star .f orming ga i axi es to the UVB, 

tra of the Lya forest enabled a statistical an alysis of the ab - as weU as tQ ide a k ingredient to numeri cal simulations 

sorbers, as well as their physical properties (e.g.| Kimetal. | 200U f formation. 
Scha ve et al.ll2003l:lKim et al.ll2004h . 

The vast majority of H i Lya absorbers are optically thin There are different ways to constrain the H i UVB photoion- 

to ionising photons and are thus kept highly photoionised isation rate in the IGM - Assuming its spectral energy distribu- 

tion it is possible to infer the UVB intensity at the Lyman limit 

* Based on data collected at the European Southern Observatory and J Yo - Fi rst , the UVB can be predicted by integrating the contri- 

obtained from the ESO Science Archive. butions of the observed source population. Given the luminosity 
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Fig. 1. A typical quasar spectrum from our 
sample (Q 0002-422 z = 2.768) together with 
the power law continuum fit (dashed red line) 
and the local continuum fit (blue line). 



functions of the sources, a characteristic intrinsic spectral energy 
distribution and the observed absorber distribution functions in 
the IGM, the amplitude and spectral shape of the UVB can be 
calculated numerically as the radiation is filtered by the IGM 
(Bechtold et al. 1987). In particular, comparing these models to 
observatio ns provides constraints on the relative con tributions 
of quasars dHaardt & Madaulll996t|Fardal et alj[l998l) and star- 
forming galaxies (Haardt & Madau 2001). 

Furthermore, the Hi photoionisation rate at 2 < z < 4 
has been constrained by matching the Lya forest absorption 
and the IGM temperature evolution from numerical simula- 
tions of struc t ure fo r mation to obs ervations (Rauch et al. 1997; 



Theuns et al] 119981; iMcDonald et al. 2000; Meiksin & White 



2004 ;lTvtler et al.l2004tlB~olton et al]2005l;lKirkman et al]2005t 
Jena et al. 2005). 



A more direct approach to estimate the UVB photoioni- 
sation rate is based on the so-called proximity effect. In the 
vicinity of a luminous quasar the UV radiation field is ex- 
pected to be enhanced, resulting in a statistical deficit of Lya 
absorbers near the quasar compared to far away from it along 



the line of sight dWevmann et al] fl98"ll ICarswelletaT1ll982l; 
iMurdoche t al. 1986). Knowing the UV luminosity of the quasar, 
the deficit of lines (or generally Lya opacity) yields an esti- 
mate o f the UVB in t ensity at the H i Lyman limit dCarswell et al] 
Il987t iBaitlik et al] Il988l) . Traditionally, the proximity effect 
has been considered as a statistical effect and large samples 
of up to ~ 100 quasars have been compiled to measure the 
mean UVB at 2 <, z $ 4 (e.g. Bajtliketal. 1988; Lu et all 



l99"TllGiailongo et al.ll996HCooke et al.ll997tlScott et al.l2000t 



Liske & Willigerl 120011) . Nevertheless, the proxi mity effect can 
also be detected towards individual quasars (e.g. IWilliger et al] 
1994; Cristiani et afMUl iLu et al.lfl996t ISavaglio etal.ll 19971 
Dall' Aglio et al. 2008). 

Proximity effect analyses at different redshifts can constrain 
the redshift evolution of the UVB, showing that it broadly peaks 
at z ~ 3. The decrease in the U VB at z < 2 ([K ulkarni & Fall 
1993; Sco tt et alj|200 2) and z Z 4 (IWilliger et al.ll 1 994t ILu etai] 
1996; Savaglio et al] 1 1997b is likely due to the declining spac e 



density of quasars dHaardt &Madaulll996l; iFardalet alj [l998). 
Whereas the UVB evolution at low red shifts is suf ficiently fast 
to be detectable within a single sample dScott et al.l|20 02), there 
is presently little direct evidence of evolution within the redshift 
range 2 ;£ z ^ 4. 

It is currently an open issue whether the measured 
UVB at z ^ 3 is consistent with the integrated emis- 
sion of quasars, or whether a significant share of ionising 
photons has to be provided by s tar-fo r ming galaxies (e.g. 
iMadau et al] 119991; ISokasian et al] 120031: Schirber & Bullock 



120031: lHuntetal.1 120041) . One difficulty lies in the fact that the 
UVB estimates via the proximity effect are subject to several 
systematic uncertainties, all of which can lead to an overestimate 
of the inferred UV background: 

1. Quasar variability: The size of the proximity effect zone 
scales as the average quasar luminosity over the photoion- 
isation equilibrium timescale in the IGM (~ 10 4 yr). Quasar 
variability on shorter timescales will tend to overestimate the 
UVB due to Malmqu ist bias in the selected quasar samples 
dSchirber et all 2004). It is not known how important this ef- 
fect is in practice. 

2. Underestimated quasar redshifts: Quasar emission redshifts 
determined fro m broad high-ionisation lines are like ly under- 
estimated (e.g. lGaskelllll982l;lRichards et alJl2002b, causin g 
the UVB to be overestimated by a factor ~ 3 (Espey 1993). 
However, this effect can be largely avoided by using low- 
ionisation lines to determine systemic redshifts. 

3. Overdense environment : In the standard i onisation model 
of the proximity effect (Bait lik et al] 1 19881) . the Lya forest 
line density is extrapolated into the quasar vicinity, assum- 
ing that the matter distribution is not altered by the pres- 
ence of the QSO. If quasars typically reside in high intrin- 
sic overdensities inst ead, the UVB will be ove restimated by 
a factor of up to ~ 3 dLoeb & Eisensteinll 19951) . Conversely, 
the disagreement between the UVB estimates from the prox- 
imity effect and those obtained by matching simulations 
to the mean Lya forest absorption has recently been used 
as an argument that quasars are surrounded by substantial 
overdensities jR ollinde et al. 2005; Guima raes et al., 2007; 
iFaucher-Giguere et al]|2008bb . 

In the present paper we pursue a new approach to employ 
the proximity effect as a tool to investigate the UVB, based on 
measuring its signature towards individual Q SO sight lines. We 
demonstrated recently ( Dall' Aglio et al . 2008, hereafter Paper I) 
that indeed essentially all quasars show this signature, even at 
relatively low spectral resolution. Here we follow up on this find- 
ing, now based exclusively on high resolution, high S/N quasar 
spectra. The plan of the paper is as follows. We begin with a 
brief description of our spectroscopic data (Sect. |2). In Sect. [3] 
we explain the Monte Carlo simulations used to assess uncer- 
tainties and to interpret the observed proximity effect strength 
distribution. We then determine the redshift evolution of the ef- 
fective optical depth in the Lya forest in Sect. |4j followed by a 
comparison between the two most commonly adopted methods 
of revealing the proximity effect in Sect. [5] We very briefly re- 
port on the analysis of the combined QSO sample in Sect. [6] In 
Sect. [7] we investigate the proximity effect in individual sight- 
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lines, showing that the traditional sample-combining method is 
biased. We then estimate the excess Lya absorption near quasars 
(Sect. [8), and use this to constrain the redshift evolution of the 
UVB (Sect. [9). We present our conclusions in Sect.fTOl 

Throughout this paper we assume a flat universe with 
Hubble constant Hq = 70 kms -1 Mpc and density parameters 
(Q m ,QA) = (0.3,0.7). All distances are expressed in physical 
units. 



2. Data 

2.1. Sample description and data reduction 

The sample consists of 40 quasar sight li nes observed with the 
UV- Visual Echelle Spectrograph (UVES. lDekker et alj|2000h at 
VLT/UT2 on Cerro Paranal, Chile. All 40 spectra were taken 
from the ESO archive and are publicly available. We selected the 
QSO sample based on the following criteria: (i) a minimum of 
10 exposures and (ii) a complete or nearly complete coverage of 
the Lya- forest region especially close to the quasar. Table[T]lists 
the complete sample of quasars with adopted redshifts (Sect. l2.4l i 
and quasar luminosities at the Lyman limit (Sect. l2~3l . 

The data were reduced within the ECHELLE/UVES envi- 
ronment (version 2.2) of the softwa re packa ge MIDAS and fol- 
lowing the procedures described in iKim et a l. (2004). After the 
bias and inter-order background subtraction from each science 
frame, an optimal extraction of the spectrum was performed, or- 
der by order, assuming a Gaussian distribution along the spatial 
direction. The sky was estimated and subtracted together with 
the Gauss ian fit, maximi sing the quality of the extracted spec- 
trum (e.g. Kim et al. 2001). Cosmic rays were identified and re- 
moved using a median filter. The wavelength calibration was 
performed with the available ThAr lamp frames. Relative flux 
calibration was performed using the master-response functions 
publicly available on the ESO website and accounting for differ- 
ent airmasses. This allowed us to place our spectra onto a rela- 
tive flux scale reasonably well, while the absolute scale had to 
be tied to external photometry (Sect. l2T2l >. In each final coadded 
spectrum the individual extractions were weighed corresponding 
to their S/N and re-sampled on 0.05 A bins. The resolving power 
is ~ 45 000 in the regions of interest, corresponding to a velocity 
resolution of ~ 6 kms 1 (FWHM). The wavelengths in the final 
spectra are vacuum heliocentric, and the fluxes are corrected for 
galactic reddening. An example of a final spectrum as well as 
our continuum definitions (Sect. |2~3l is shown in Fig.Q] 



Table 1. List of analysed QSOs, ordered by redshift. 



QSO 


Mag 


Filter 


S/N 


A 


iogi; 


7 + 
vein 


HE 1341-1020 


17.1 


B 


70 


139 


31.17 


2.137 


Q 0122-380 


16.7 


B 


60 


291 


31.51 


2.192 


PKS 1448-232 


17.0 


V 


70 


282 


31.50 


2.222 


PKS 0237-233 


16.6 


V 


100 


750 


31.93 


2.224 


HE 0001-2340 


16.7 


V 


60 


403 


31.68 


2.278 


HE 1122-1648 a 


16.5 


V 


120 


866 


32.05 


2.407 


Q 0109-3518 


16.4 


B 


70 


404 


31.72 


2.406 


HE 2217-2818 


16.0 


V 


80 


796 


32.02 


2.414 


Q 0329-385 


17.0 


V 


50 


226 


31.48 


2.437 b 


HE 1158-1843 


16.9 


V 


60 


268 


31.56 


2.459 


Q 2206-1958 


17.3 


V 


70 


255 


31.57 


2.567 


Q 1232+0815 


18.4 


r 


50 


055 


30.91 


2.575 


HE 1347-2457 


16.8 


B 


60 


772 


32.06 


2.615 


HS 1140+2711 a 


16.7 


r 


80 


581 


31.94 


2.628 


Q 0453-423 


17.1 


V 


70 


168 


31.41 


2.664 


PKS 0329-255 


17.1 


V 


50 


243 


31.58 


2.706 


Q 1151+0651 


18.1 


r 


50 


100 


31.21 


2.758 


Q 0002-422 


17.2 


V 


60 


346 


31.76 


2.769 


Q 0913+0715 


17.8 


r 


60 


181 


31.48 


2.788 


HE 0151-4326 


17.2 


B 


70 


499 


31.92 


2.787 


Q 1409+095 


18.6 


r 


40 


067 


31.06 


2.843 


HE 2347-4342 


16.7 


V 


100 


630 


32.05 


2.886 


Q 1223+1753 


18.1 


r 


40 


794 


31.16 


2.955 


Q 0216+080 a 


18.1 


V 


40 


084 


31.20 


2.996 


HE 2243-6031 


16.4 


V 


100 


776 


32.17 


3.012 


CTQ 0247 


17.4 


V 


70 


239 


31.66 


3.025 


HE 0940-1050 


16.4 


V 


50 


691 


32.13 


3.089 


Q 0420-388 


16.9 


V 


100 


426 


31.93 


3.120 


CTQ 0460 


17.5 


V 


60 


281 


31.76 


3.141 


Q 2139-4434 


17.7 


V 


40 


117 


31.39 


3.207 


Q 0347-3819 


17.7 


V 


60 


213 


31.66 


3.229 


PKS 2126-158 


17.0 


V 


60 


380 


31.92 


3.285 c 


Q 1209+0919 


18.6 


r 


40 


120 


31.42 


3.291 c 


Q 0055-2659 


17.5 


V 


60 


245 


31.81 


3.665 c 


Q 1249-0159 a 


18.6 


g 


60 


071 


31.27 


3.668 


Q 1621-0042 


17.3 


r 


70 


307 


31.91 


3.709 


Q 1317-0507 


17.7 


R 


50 


084 


31.35 


3.719 


PKS 2000-330 a 


17.0 


V 


60 


178 


31.69 


3.786 


BR 1202-0725 


17.8 


K 


100 


460 


32.24 


4.697 


Q 1451-1512 


17.3 


I 


60 


332 


32.12 


4.766 



%\ Lyman limit flux in units of /iJy with uncertainties around 7%. 
*: Lyman limit luminosities in units of erg s" 1 Hz with uncertainties of the 
order of o-i ogL ,, o ^*™ s dex. 

t: Sys temic redshift estimated from Sin+Oi at i rest = 1305. 77A (Morton 

2003). Redshift uncertainty is o% = 0.003. 
a: Gaps in the spectral range of the hya forest, 
b: Redshift measured from Civ emission line and corrected according to 

Richards et al. (2002). 
c: Redshift taken from Paper I. 



2.2. Quasar magnitudes 

Table Q] provides our adopted apparent magnitudes and Lyman 
limit fluxes. The photometric d ata were collected from vari - 
ous sources, in particular SPSS. IVeron-Cettv & Veron (2006), 

J2005I) . 



iRollinde et all (120051) . ICooke et all d 1997b . lEllison etaL 



and Paper I, Where more than one measurement was available, 
the data were consistent to within cr„, < 0.1 mag. Note that while 
knowledge of the Lyman limit luminosity is indispensable for the 
quantitative interpretation of the proximity effect, even perfectly 
simultaneous high-S/N photometry would not account for the 
effects of quasar variability averaged over the photoionisation 
time scale. By randomly changing the flux scale of some objects 
by up to 20% we confirmed that our conclusions concerning the 
proximity effect are not affected by photometric uncertainties. 



2.3. Continuum definition 

In order to search for the proximity effect, we needed to convert 
the quasar spectra into continuum-rectified transmission spectra. 
We also needed to know the quasar flux at the Lyman limit. To 
achieve this we determined two types of continua: (i) a global 
power law (f v cc ■/"), excluding emission and absorption re- 
gions, used to estimate the quasar flux at the Lyman limit and 
(ii) a more local estimate that also includes the broad emission 
lines as a quasi-continuum, used to compute the transmission 
spectrum. We constrained the Lyman limit flux via a power law 
continuum fit since in most cases this wavelength is either not 
covered by the observations or is located in the far blue range of 
the spectrum where the S/N significantly drops. 

We developed an algorithm to a utomatically fi t the local 
continuum, building on the work by lYoung et alj d 19791) and 
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Fig. 2. Top panel: Average ratio between the fitted and input con- 
tinuum for the five sets of 500 simulated QSOs at z = 2.0, 2.5, 
3.0, 3.5, 4.0 with S/N - 70, denoted with numbers 1, 2, 3, 4 and 
5 respectively. Bottom panel: Standard deviation profiles relative 
to the above systematic bias. 



ICarswell et al.l dl982l) . A cubic spline was interpolated on adap- 
tive intervals along the spectrum. The fixpoints for the spline in- 
terpolation were chosen starting from a regular sampling of the 
spectrum with a binning that becomes finer whenever the slope 
of the computed continuum exceeds a given threshold. This was 
done in order to better reproduce the wings of emission lines. 

To assess the continuum uncertainties we proceeded in the 
same way as described in Paper I, With the help of Monte Carlo 
simulations we computed the average ratio between the recov- 
ered and the input continua at different redshifts. The results are 
presented in Fig. [2] The top panel shows the mean systematic 
error of the fitted continuum with respect to the input continuum 
for five different redshifts. The bottom panel presents the intrin- 
sic uncertainties of the continuum. Due to the high resolution 
and the high S/N of the spectra, the statistical error associated 
with continuum placement is limited to a few percent at most 
in the Lye line wing. The automatically fitted continuum was 
corrected for the systematic bias and used to compute the trans- 
mission T = F qso /F cont . 

Regarding the Lyman limit fluxes, the uncertainties are of the 
order of 7%, dominated by the somewhat subjective choice of 
the continuum wavelength ranges redward of the Lya emission 
used to fit the power laws. 

2.4. Systemic quasar redshift 

The spectral range covered by the UVES observations can maxi- 
mally extend from ~3 000 to -10000 A. However, not all QSOs 
have such wide wavelength coverage. Most of them extend far 
enough to the red of Lya to allow the detection of several 
emission lines (Sin+Oi, Cn, Siiv+Oiv], C iv) from which a 
redshift can be measured. Several autho rs (e.g. lGaskelli ri982; 
lTytler&Fanlll992l: iRichards et all 120021) pointed out the exis- 
tence of a systematic shift between high and low ionisation lines 
attributed to the relative motion of gas near the AGN. In order to 
measure a redshift as close as possible to the systemic one, we 
used low-ionisation lines if these were available. In almost all 
cases we adopted Si n+O i measurements for the final emission 
redshift, as listed in Table [Q For four objects (PKS 2126-158, 
Q 0329-385, Q 1209+0919 and Q 0055-2659) this was not 
possible due to either a non-detection of these lines or lack of 



wavelength coverage. For PKS 2126-158, Q 1209+0919 and 
Q 0055-2659 we adopted the redshifts based on Sin+Oi from 
the low-resolution spectra in Paper I, while for Q 0329-385 we 
could only take the C iv based redshif t and correct e d it fo r the 
mean systematic shift determined bv lRichards et al. (2002). 



3. Monte Carlo simulations of artificial spectra 

A deeper understanding of statistical and systematic effects con- 
tributing to the proximity effect signature is made possible by 
comparing observations with simulated spectra. Typically, nu- 
merical 3D simulations are successful in reproducing the prop- 
erties of the Lya forest at any redshift. However, such computa- 
tions are very time consuming and their major shortcoming is the 
limited redshift coverage of the simulated sight lines, especially 
at high resolution. 

We developed a straightforward Monte Carlo code to gen- 
erate synthetic spectra and employed the simulations for three 
main purposes. First, to estimate the influence of the quasar con- 
tinuum placement in the spectra (Sect. [23]); then to compute the 
line-of-sight variations in the evolution of the optical depth in 
the Lya forest (Sect. 0}; and finally to study the influence of 
the fact that only a finite number of absorbers contributes to the 
measured optical depth (Sect. |5.3b . 

The procedure used to generate synthetic spectra is based on 
the assumption that the Lya forest is well represented by three 
observed distributions: 

1. The line number density distribution, approximated by a 
power law of the form dn/dz °c (1 + z) y where y will be 
measured in Sect. [4] 



Hi 



The column density distrib ution, given by f(Nui) x N, 
where the slope is/3 ^ 1.5 dKim et al.ll2001[) . 
The Doppler parameter distribution, given by dn/db 
b- 5 exp [-b^/b 4 ] where b a =* 24 km/s dKim et al.ll2001l) . 



The simulated absorbers have column densities within the range 
10 12 < A^hi < 10 18 cirT 2 and Doppler parameters between 10 < 
b < 100 km/s. The slope of the column density distribution was 
fixed to (3 - 1.5. 

For our purposes these approximations are sufficient to yield 
the accuracy we need in the following analysis. Every simu- 
lated sight line was populated with absorption features drawn 
from the above distributions until the computed effective optical 
depth was consistent with its evolution presented in Sect. [4] Once 
the simulated transmission was computed, an artificial quasar 
spectral energy distribution, including emission lines of varying 
strengths and widths, was genera t ed v ia the principal compo- 
nents method described by Suzuki (2006) and already employed 
in Paper I. Gaussian noise was added to the final quasar spec- 
trum, in order to match the S/N level of our observed objects. 



4. Evolution of the Lya effective optical depth 

The H i effective optical depth is related to the mean transmission 
as T e ff = -ln(T) = -rn(e~ THl ), where ( ) indicates the average 
over predefined redshift intervals. Note that the effective optical 
depth is defined as the negative logarithm of the average pixel 
by pixel transmission, and not as the average value of the pixel 
by pixel optical depth in a given redshift interval. Its redshift 
evolution (Zuo 19931) is usually well represented by a power law 



Teff=T„(l+zF +1 . 



(1) 
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- Kim et al. 07 
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Fig. 3. Observed effective optical depth as a 
function of redshift after removal of pixels con- 
taminated by Lya absorption lines with damp- 
ing wings, Ly limit systems and the proxim- 
ity effect. Measurements from each individual 
quasar are shown in the upper panel, while 
those from the combined sample of QSOs are 
shown in the lower panel. The solid curve 
shows the power law least-squares fit to the data 
while the dashed curve indicates the evolution 



of the Lya optical depth fitted by Schaye et al. 



(2003) and the dotted line that by iKim et al 
20071) 



Table 2. Effective optical depth in the Lya forest of our com- 
bined QSO sample. 



<z> 



Az 



TeB 



1.874 


0.15 


0.166 


0.021 


2.024 


0.15 


0.180 


0.026 


2.174 


0.15 


0.185 


0.028 


2.324 


0.15 


0.217 


0.031 


2.474 


0.15 


0.270 


0.035 


2.624 


0.15 


0.327 


0.040 


2.774 


0.15 


0.349 


0.042 


2.924 


0.15 


0.378 


0.046 


3.074 


0.15 


0.420 


0.051 


3.224 


0.15 


0.388 


0.054 


3.374 


0.15 


0.439 


0.061 


3.524 


0.15 


0.569 


0.068 


3.749 


0.30 


0.726 


0.054 


3.974 


0.15 


0.807 


0.084 


4.124 


0.15 


0.861 


0.093 


4.274 


0.15 


0.967 


0.095 


4.483 


0.27 


1.093 


0.099 



We explored two methods of determining the evolution of T e ff 
with redshift. 

In the first approach each Lya forest spectrum was divided 
into two redshift intervals, each covering the same redshift path 
length to sample the increasing opacity along single sight lines. 
The upper panel of Fig. [3] shows the results obtained using 
all those pixels in the Lya forest range decontaminated from 
damped Lya or Lyman limit systems (DLAs and LLSs respec- 
tively) and the proximity effect region (Av < 5000km s were 
excluded). 

The second approach consists of measuring the mean T e ff in 
the forest of all quasars intersecting a particular redshift slice 
(Az = 0.15). The results are shown in Table [2] and in the lower 
panel of Fig. [3j yielding best-fit values of (log to, y) - (-2.21 ± 
0.09,2.04 + 0.17). 

For both approaches the uncertainties in the effective optical 
depth, cr TcR , quantify the amount of variance between the indi- 
vidual lines of sight for the considered redshift range. 



In Figure [3] we present the results from the two approaches 
in comparison to the evolution of the Lya optical depth as 
measured by lSchaye et a l. (2003), using a similar technique on 
19 QSO spectra taken with UVES and HIRES and the fit by 
iKim et al. (200 7D combining 1 8 UV ES spect ra. Our results a gree 



well with both lSchayeetalJ (l2003h and iKimetalJ (12007!) fits. 
There is less agreement at high redshift, probably due to the lim- 
ited number of QSOs at z > 3.6, but our results are formally 
consistent within the errors. 

Although both panels use the same data, these were com- 
bined in different ways and thus return slightly different results. 
It is clear from the top panel that the first method suffers from 
a lack of data points in the range 3.6 < z < 4, leading us to 
slightly underestimate the effective optical depth at high redshift. 
The second approach significantly reduce s the scatte r caused by 
cosmic variance as already pointed out bv lKim et al.l (|2002). It is 
also in good agreement with literature estimates. Therefore we 
adopt the best-fit parameters from the second method to describe 
the redshift dependence of the normalised effective optical depth 
in our quasar spectra. 

In the bottom panel of Fig. [3] we identify a marginally sig- 
nificant departure of r e g from the power law evolution in the 
red shift range 3.2 < z < 3.4. This feature, first discovered 
by Bernardi et al. (2003) using SDSS quasar spectra (but see 
iMcDonald et al.l 120051) . has been been interpreted to be a re- 
sult of one or more of the following effects: (i) a change in 
the IGM temperature; (ii) a change in the free electron number 
density; or (iii) an enhancement in the U V background possibly 
connec ted to Hen reionisation. Recently. iFaucher-Giguere et al.l 
(2008c) found the same dip in r e ff(z) using a sample of ESI and 
HIRES spectra. In the light of this debate and using a completely 
independent data sample, we confirm the detection of this fea- 
ture. We note, however, that its significance is only 2.6<x (two 
pixels with each 1.8<x), so the detection can be called no more 
than tentative. 



5. Methods of quantifying the proximity effect 

The direct signature of an enhanced ionisation field near bright 
quasars is a reduction of the neutral hydrogen fraction on a phys- 
ical scale of several Mpc. Two principal techniques to detect it 
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have been developed in the last two decades, which we briefly 
review in the following subsections. 

5.1. Flux transmission statistics 

The method used in this work to reveal the proximity effect 
along single lines of sight is based on the comparison between 
the observed effective optical depth and the expected one in 
the Lya forest (Liske & Williger 2001). Approaching the quasar 
systemic redshift, the photoionisation rate of the source starts to 
dominate over the UVB. This effect leads to an enhancement in 
H + relative to H°, reducing the opacity of absorbers close to the 
QSOs. This influence modifies the effective optical depth, which 
becomes 



(2) 



Teff =T (l+z) r+1 (l+w)W 

dLiske & WilligerluOOll) where /? is the slope in the column den- 
sity distribution and co is the ratio between the quasar and back- 
ground photoionisation rates. 

Following the assumptions outlined in Bait lik et all 0988) 
to compute u, we get 



<o(z) 



MMl+z)) 1 (d L (z q ,0) 



4nJ V0 (l+z)\d L (z q ,z) 



(3) 



with z as the redshift along the LOS such that z < z q , di(z q ,Q) 
the luminosity distance of the QSO to the observer, and di(z q , z) 
as seen at any foreground redshift in the LOS. 

Equation[3]implies that the spectral shape of the QSO and the 
background are approximately the same around 1 Ryd, which 
might not be exactely true. Assuming a qu asar spectral shape 
f y oc V, with a q =* -0.5 dVanden Berk et al. 2001, 1) and tak- 
ing a background spectral index of a>b =s — 1.4 dAgafonova et alj 
2005), the resulting scale of u> is shifted by ~ 0.1 dex. However, 
there may be an indication of a break in the spe ctral slope of 
quasars around the Lyman limit (T elfer et al.l 2002). Such a break 
would make the quasar spectrum more similar again to that of the 
background, reducing the effect on at. 

We adopt the following notation: The ratio of the observed 
optical depth to the one expected in the Lya forest, or the nor- 
malised effective optical depth £, is given by 



£ = 



Teff 



T (l +Z) y+1 



(1 + W) 



1-jS 



(4) 



with the parameters (log To, y) measured in Sect. [4] 

The proximity effect is apparent as a decrease in the nor- 
malised optical depth below unity as w -> oo, i.e. towards the 
quasar. We make use of this technique, first to detect the prox- 
imity effect on our combined sample of quasars (Sect. |6|, then 
towards single lines of sight (Sect. [7} and finally to assess the de- 
pendence of the measured UV background on redshift and over- 
densities (Sect. [9]). 

5.2. Line counting 

Counting absorption lines stronger than a given threshold is his- 
torically the first technique used to measure the deficit of ab- 
sorption near high redshift quasars. Typically represented by a 
Voigt profile, each absorption line has to be fitted and associated 
with a set of parameters (Nui,z,b) describing its column den- 
sity, redshift, and Doppler parameter, respectively. At medium 
resolution onl y the equivalent width can be measure d. Several 
authors (e.g., lGiallongoetai]|1996t IScott et al.ll2000l) used this 
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Fig. 4. Statistical errors associated with individual lines of sight 
using the line statistic (LS) and the flux statistic (FS) method. 
The different colu mn density thresh olds represent t he com plete- 
ness limits from [Scott et alj d2000t) and iHu et all d 19951) (solid 
squares and triangles, respectively). The filled circles show the 
level of uncertainty if the line list were complete up to the mini- 
mum column density at our resolution and S/N. 



approach to detect the proximity effect and to measure the UV 
background on combined s amples of QSOs with the formalism 
introduced by Baitli k et all dl988t) . It is clear that at low spectral 
resolution, line counting is vastly inferior to the flux transmis- 
son statistic because of line blending. On the other hand, at the 
high resolution of UVES and similar instruments, line counting 
could still be a reasonable approach. We therefore conducted a 
performance comparison of the two techniques, following the 
prescription in Sect. [3] We simulated the Lya forest of a quasar 
at redshift z — 3, obtaining not only the spectrum but also keep- 
ing the complete line list. We repeated this step to create 500 
independent simulated spectra. 

The principal limitation of the absorption line fitting ap- 
proach is line blending, leading to incompleteness of weak lines 
at low column densities. Even at high resolution where lines with 
logA^Hi - 12.5 are detectable, th e completenes s is < 25% for 
column densities log A'h i < 13.2 dHu et al.l[l9 95). Another prob- 
lem in fitting absorption lines is that there is no unique solu- 
tion, and much is left to the experience and ability of the scien- 
tist/software code in finding a good fit. For our simulation study 
we employed the code AUTOVHj to fully automatically fit an 
array of absorption lines to each spectrum. The proximity effect 
signature is then a decrease in the number density of lines N 
relative to that expected for the redshift. Thus we can define an 
alternative quantity 



* No 



(5) 



which again is expected to decrease from unity to zero as u> in- 
creases. We measured £, (using the flux transmission statistic) 
and f (from the automated line counts, adopting different col- 
umn density thresholds) for all 500 simulated spectra, and com- 
puted mean and dispersion values for several bins of log u>. 

Figure |4]presents the results of this study, showing the stan- 
dard deviation of £ or £', i.e. the statistical error of the measure- 
ment for a single line of sight, as a function of u> (approaching 
the quasar). For a realistic completeness limit in column density 
logA^ei > 13, the flux transmission approach is always more 
sensitive than line counting. In the unrealistic ideal case where 
we used the true input line lists, the two methods are equiva- 
lent at low u>, but even then the line counting approach fails in 
probing £,' very close to the emission redshift of the quasar. This 
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Fig. 5. Distribution of the normalised optical depth £ under the 
influence of increasing to values. The histograms represent the £ 
distribution of 500 simulated spectra with zqso = 3. 



can easily be understood as the quasar radiation reduces the col- 
umn densities by a factor 1 + u; thus, close to the quasar, where 
a) ^ 100, original column densities of logA^i ^15 are needed 
to produce a detectable absorption line. Such absorbers are very 
rare, which leads to increased uncertainties. 

We conclude that line counting is less sensitive to the ex- 
pected proximity effect signature than the flux transmission 
method, even at high spectral resolution, and all our results will 
be based exclusively on the flux transmission technique. 

5.3. Poissonian variance between lines of sight 

At the spectral resolution in our sample, the major source of un- 
certainty is due to the variation in the number of absorption fea- 
tures along individual lines of sight. The probability of finding 
or not finding an absorption line at a given redshift is to first ap- 
proximation a Poissonian process which can be easily modelled 
by our Monte Carlo simulations. While a full accounting of the 
expected effects of cosmic variance due to the large-scale struc- 
ture of the IGM would require cosmological 3D simulations, it 
is actually useful to start with the Poissonian approximation, as 
it allows us to appreciate to what extent the observed level of 
variance is consistent with pure Poisson noise. 

Equation [3] shows that a> depends on the redshift and lumi- 
nosity of the quasar, implying that each QSO will have its own 
particular log u> scale. Consequently, in a fixed log o> interval the 
influence of Poisson noise will vary from line of sight to line of 
sight, since the corresponding redshift range in the Lya forest is 
determined by the quasar emission redshift and its Lyman limit 
luminosity. Therefore, the distribution of the normalised optical 
depth £ as a function of log to will depend on (i) Poisson noise, 
(ii) quasar redshift, and (iii) quasar luminosity. 

We studied how the distribution of £ is affected by different 
UV radiation fields (i.e. in different log to bins) at a given red- 
shift. We computed the standard deviation cr given by 
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Fig. 6. Normalised effective optical depth versus a> for the com- 
bined sample of 40 quasars, binned in steps of A log to — 1 . 
The curved lines are the best fit of the simple photoionisa- 
tion model to the data, corresponding to a UV background of 
log(7 Vo ) = -21.10 (solid line) in units of erg crrT 2 s Hz ' sr -1 , 
while the dotted curve denotes to the fiducial UVB (/*) for the 
computation of u>. The horizontal dashed line illustrates the case 
of no proximity effect. 



where P(^) describes the probability density function of £ esti- 
mated using our mock catalogue of sight lines as displayed in 
Fig- El and jj is its mean value. For illustration purposes, we as- 
sumed a quasar at redshift z - 3 and luminosity log L Vo =31 .5 
with a binning of A log a> - 1 . Each panel displays how Poisson 
noise affects a different portion of the Lya forest according to the 
quasar properties, i.e. for different values of u. The final error 
bars in the proximity effect analysis are a composition of the fol- 
lowing three effects, ordered by descending relative importance: 
(i) the standard deviation computed above, (ii) the continuum 
uncertainties (Sect. 12. 3t and (iii) the intrinsic noise present in 
the spectrum. The Poisson noise in the placement of lines dom- 
inates the total error. Continuum uncertainties and the intrinsic 
noise are almost negligible. 



6. The proximity effect in the combined sample of 
quasars 

We first present briefly the evidence of the proximity effect in 
the traditional way, as a signal in the combined full sample of 
QSOs. The result is displayed in Fig. [6] As expected, the nor- 
malised effective optical depth £, starts at unity for a> <k 1 
and then goes down to zero for u> » 1 . In the definition of a> 
(Eq. [3} we had to assume a fiducial value of the UVB intensity, 
J* = 10~ 21 ergcm _2 s _1 Hz ' sr -1 . This uniquely converts the 
redshift scale into an u> scale. We defined a regularly spaced grid 
along the log a> axis and in each bin we determined the average 
transmission and effective optical depth values, and using Eq. [4] 
the corresponding values of £. We then modelled the decrease in 
£ with log(w) according to the formula 



F(io) 



-K) 



1-/3 



(7) 



o* = (£- M ) 2 />@d£ 



(6) 



where a is the single free parameter which expresses the ob- 
served turnover of £ and thereby provides the best-fit value of 
J Vo , since obviously J Vo — a x J*. The slope of the column den- 
sity distribution was fixed to/? = 1.5 (see Sect.[3]for details). 

For the median redshift of our sample of z - 2.73 we 
thus obtain J Vo = (7.9 + 3.1) x 10~ 22 ergcirT 2 s~' Hz~' sr~', 
or in logarithmic units log/ Vo = —21.10*241 This number is 
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Fig. 7. The proximity effect signatures in individual lines of sight, for a subsample of 9 QSOs. Each panel shows the normalised 
effective optical depth £ versus u>, binned in steps of A log co = 1, with the best-fit model of the combined analysis superimposed as 
the dotted red line (see Sect. |6j. The solid lines delineate the best fit to each individual QSO as described in the text. This subsample 
was chosen for presentation purposes to show the variable strength of the proximity effect, going from strong (top-left panel) to 
weak (bottom-right panel). 



very close to the value of log7 Vo = -21.03 reported by us 
in Paper I and is also consistent with several other literature 
estimates. A detailed comparison with the literature is ham- 
pered by the fact that the vast majority of previous UVB mea- 
surements were derived adopting the almost obsolete Einstein- 
de Sitter model. Typically, values for J V(j are then about a fac- 
tor of 1.4 (0.15 dex) higher than in a A-Universe. lCooke et al.l 
d 19971) measured losJ v „ = -21.0 + °;}g on 11 high resolution 
quasar spectra using line statistics. IScott et all ([2000) obtained 
log/ Vo = -21.15*g43, a PPly m 8 tne same method on more than 
a hundred spectra at ~ 1 A resolution. Liske & Williger (2001) 
used the flux statistic on 10 QSO spectra with ~ 2 A resolution 
and a S/N of ~ 40, obtaining log J V( , = -21 .45^°. 

While the formal errors of this measurement are small, there 
are reasons to believe that the proximity effect exploited this 
way delivers systematically too high values of J Va . Overdense 
environments around quasars have been suggested as the prime 
reason; we shall demonstrate in the next section that in fact the 
averaging process inherent in the sample combination is respon- 
sible for a major bias in the UVB determination. 



7. The proximity effect in individual lines of sight 

7. 1 . The distribution of the proximity effect strengths 

For our investigation of the proximity effect towards single lines 
of sight, the approach was essentially identical to that of the 
combined analysis: We computed the normalised effective opti- 
cal depths for individual sight lines within a given range A log u> 
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Fig. 8. Observed distribution of the proximity effect strength 
(given by log a) for our sample of objects. The distribution is 
characterised by a prominent peak and a skewed profile which 
extends over several orders of magnitude in strength. 



and checked whether £, systematically decreases for high val- 
ues of a). For presentation purposes, the results of a subsam- 
ple of 9 objects are displayed in Fig. [7] one panel per quasar 
(see Appendix lAl for the complete sample). The error bars are 
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Fig. 9. Proximity effect strength distributions in our synthetic spectra for different quasar redshifts (left-hand panel) and luminosities 
(right-hand panel). The distributions are computed from 500 artificial sight lines generated by our Monte Carlo code as described 
in Sect.[3]and are affected only by Poissonian shot noise. 



Table 3. The proximity effect strength log a along single lines of 
sight. 



QSO 


<-em 


log< 


log a 


Q 1232+0815 


2.575 


30.91 


-1.89 ±0.37 


Q 0329-385 


2.438 


31.48 


-1.86 ±0.29 


PKS 0329-255 


2.706 


31.58 


-1.86 ±0.25 


HE 0001-2340 


2.278 


31.68 


-1.46 ±0.36 


HE 1347-2457 


2.615 


32.06 


-1.43 ±0.25 


Q 0216+080 


2.996 


31.20 


-1.26 ±0.36 


HE 2217-2818 


2.414 


32.02 


-1.21 ±0.31 


Q 0109-3518 


2.406 


31.72 


-1.10 + 0.38 


Q 1249-0159 


3.668 


31.27 


-1.08 ±0.22 


PKS 2126-158 


3.285 


31.92 


-0.99 ± 0.22 


Q 1209+0919 


3.291 


31.42 


-0.85 ± 0.29 


Q 0913+0715 


2.788 


31.48 


-0.84 + 0.34 


Q 0002-422 


2.769 


31.76 


-0.78 ±0.32 


PKS 1448-232 


2.222 


31.50 


-0.75 ± 0.47 


Q 0055-2659 


3.665 


31.81 


-0.67 + 0.20 


HS 1140+2711 


2.628 


31.94 


-0.63 ±0.35 


HE 2243-6031 


3.012 


32.17 


-0.61 ± 0.24 


CTQ 0460 


3.141 


31.76 


-0.61 ±0.27 


HE 0940-1050 


3.089 


32.13 


-0.49 ± 0.26 


Q 1621-0042 


3.709 


31.91 


-0.49 ± 0.20 


Q 1151+0651 


2.758 


31.21 


-0.45 ± 0.46 


PKS 2000-330 


3.786 


31.69 


-0.45 ± 0.23 


Q 0122-380 


2.192 


31.51 


-0.42 + 0.44 


Q 1409+095 


2.843 


31.06 


-0.33 ± 0.54 


Q 0347-3819 


3.229 


31.66 


-0.23 ± 0.30 


Q 0420-388 


3.120 


31.93 


-0.18 ±0.32 


Q 1451-1512 


4.766 


32.12 


-0.01 ±0.14 


Q 1317-0507 


3.719 


31.35 


+0.13 ±0.31 


Q 0453-423 


2.664 


31.41 


+0.18 ±0.45 


HE 1122-1648 


2.407 


32.05 


+0.30 ±0.33 


HE 1158-1843 


2.459 


31.56 


+0.35 ±0.38 


BR 1202-0725 


4.697 


32.24 


+0.51 ±0.14 


Q 1223+1753 


2.955 


31.16 


+0.58 ±0.36 


CTQ 0247 


3.025 


31.66 


+0.76 ± 0.25 


HE 2347-4342 


2.886 


32.05 


+0.87 ±0.17 


Q 2206-1958 


2.567 


31.57 


+ 1.15 ±0.21 


HE 1341-1020 


2.137 


31.17 


+ 1.51 ±0.14 


PKS 0237-233 


2.224 


31.93 


+2.07 ±0.12 


Q 2139-4434 


3.207 


31.39 


+2.32 + 0.26 


HE 0151-4326 


2.787 


31.92 


+2.57 ±0.15 



f: Lyman limit luminosities and uncertainties (0"iogL v 
of ergs -1 Hz -1 



! in units 



dominated by Poissonian shot noise, estimated from the simula- 
tions as described in Sect. 15.31 In each panel, %(lo) is shown for 
the fiducial reference value J V(1 - J*. Figures 171 and IA. ll illus- 
trate that in all cases, £ decreases substantially as to increases. 
Thus we conclude that the proximity effect is detected in all of 
our quasar spectra. This is in excellent agreement with our find- 
ing in Paper I, where in only 1 out of 17 low-resolution quasar 
spectra we failed to detect the proximity effect (and for that ob- 
ject, HE 2347-4342, we now detect a weak effect in the high- 
resolution UVES spectrum; see Appendix lAii. 

We then applied the above fitting procedure (EqUJ) to each 
spectrum separately. The results are shown as the solid curves 
in Fig. lZI while Table [3] summarises the fit results. The value of 
the fitting parameter a, which describes the horizontal offset of 
the solid curve relative to the dotted one, will be regarded in the 
following as a measure of the strength of the proximity effect 
signal. It shows significant scatter between the different quasars. 
Note that the zeropoint of log a is arbitrary and depends only 
on our assumed fiducial UVB value J*. Figure [8] presents the 
measured proximity effect strength distribution (PESD), i.e. the 
distribution of log a for our sample. 

Three major characteristics emerge: 
(i) the distribution covers almost five orders of magnitude in a, 
ranging from a very weak proximity effect (a » 1) to a very 
strong one (a <K 1), 
(ii) it shows a well-defined peak, and 
(iii) it is significantly skewed. 

In the following we will investigate the effects behind these 
properties. 



7.2. The effects of variance between sight lines 

The most obvious contributor to a spread in proximity effect 
strengths is the variance in the absorber distribution between dif- 
ferent lines of sight. To investigate this effect we employed our 
Monte Carlo simulated spectra, for which by design this variance 
can be accurately described as a pure Poissonian process. 

The proximity effect was introduced in the synthetic spectra 
as a reduction in the optical depth by a factor 1 + o>, with o> given 
by Eq.[3] We first fixed the luminosity of the quasar to a value of 
log(L Vo /erg s" 1 Hz" ) = 31.5 and considered three different red- 
shifts: z = 2.0, 3.0, and 4.0, in order to see how the distribution 
of a changes with z. Then we took a constant redshift of z = 3.0 
and considered three quasar luminosities: log(L Vo /erg s Hz -1 ) 
= 31, 31.5, and 32. The UV background was fixed to J Vo - J* in 
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Fig. 10. Comparison between observed (thick) and simulated 
(thin) distribution of the proximity effect strength (given by 
log(a)) for our sample of quasars. We mark the position of the 
mode of the observed distribution and the relative error associ- 
ated to it. The error bars are computed from the dispersion of the 
mode in the 500 realisations of the simulated sample. We also 
display the value of the UVB computed in the combined analy- 
sis of the proximity effect. 



both cases. Our results are presented in Fig.|9j recall that high a 
values imply a weak proximity effect. 

Two main characteristics become apparent in Fig. [9] The dis- 
tributions are significantly skewed, and the skewness decreases 
towards higher redshifts and higher luminosities. This asymme- 
try is a direct result of the non-linear dependence of a> on red- 
shift as expressed in eq. [3] Towards the quasar redshift equal 
A login bins correspond to progressively smaller Az intervals. 
Very close to the QSO, the (Poissonian) distribution of the num- 
ber of absorbers per A login bin deviates significantly from a 
Gaussian. Similarly the distribution of effective optical depth be- 
comes skewed at z — * z em , resulting in high Teg values being 
more likely than expected for a normal distribution. The asym- 
metry of the PESD directly reflects this statistical effect. 

The dependence with redshift can be explained by the fact 
that on the one hand, Poisson noise has a weaker impact at high 
redshifts and on the other hand, an increasing luminosity is ca- 
pable of a substantial reduction in the optical depth further away 
from the quasar emission, overionising even strong systems in 
the quasar vicinity. 

Because of the asymmetric nature of the PESD at any given 
redshift and luminosity, one tends to overestimate the best fit 
values of Eq. Qwhen combining multiple sight lines together in 
an averaging process. By comparing how the distribution widths 
evolve with redshift and luminosity, we conclude that luminosity 
has a weaker effect than redshift in changing the shape of the 
PESD. 

A remarkable feature of Fig. [9] is the fact that the mode of 
the distribution always stays at the input value corresponding to 
log a - 0. We exploit this property in the next section. 

7.3. An unbiased measurement of the UV background 

Unfortunately, we do not have 500 observed quasar spectra at 
one particular redshift or luminosity, but rather a quasar sample 
distributed in redshift and luminosity. We created another set of 
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simulated spectra to predict the 'PESD as observed', assuming 
that only Poissonian variance contributes to the spread of log a, 
in the following way: We constructed 40 simulated QSO spec- 
tra with the condition that their redshifts and luminosities were 
exactly the same as the observed ones, and we constructed the 
PESD for this 'sample'. We repeated the process 500 times and 
averaged the PESD. The result is shown in Fig.[10]as a thin his- 
togram, superimposed on the observed data of our quasar sam- 
ple. 

The predicted distribution of the proximity effect strength 
parameter logo looks amazingly similar to the observed one. 
In particular, the degree of asymmetry is very nearly the same. 
The observed PESD seems to show a slightly narrower core, and 
it certainly has some outliers on both sides, at log a =* -2 and 
logo > 2. We interpret this excellent agreement as an indication 
that the statistical fluctuations of the distribution of absorption 
features between individual sight lines is responsible for most of 
the spread and in fact for most of the asymmetry in the PESD. 

What does this imply for the UV background? We again find 
that the modal value of the 'as observed' distribution recovers 
the input UVB intensity, whereas the combined analysis heav- 
ily overestimates it. From the 500 realisations we derive that the 
mode of the PESD of 40 quasars is consistent with the value of 
input model to within ±0.15 dex. Similarly we can quantify the 
bias introduced by the combined analysis. For this purpose, we 
computed the best-fit log a as in Sect. [6] and averaged it over the 
500 realisations. Typically, the averaged value of J V(1 is overesti- 
mated by A log a = 0.3 dex, or a factor of 2. 

From Fig. [10] we estimated the position of the mode of the 
observed PESD to be located at log a = -0.5 1 and converted it 
into a measurement of the UVB, yielding a value of log J Vo = 
-21.51 + 0.15. The uncertainty was derived from the dispersion 
of the mode in the simulated PESDs. This value of the UVB is 
0.4 dex lower than the best-fit of the combined proximity effect 
analysis given in Sect. [6] 

For completeness we also considered what happens when 
one computes the average of the best-fit log a values for individ- 
ual quasars (as listed in Tabled, instead of fitting the average £- 
a> profile. This results in a UVB value of log J Vo - -21.24+0.17, 
lower than the outcome of the combined proximity effect analy- 
sis as well, but still much higher than the modal value (and also 
systematically offset in the simulations). 

We compiled several literature results in measuring the UVB 
by the proximity effect together with our new our results in 
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Fig. 12. Measured intensity of the UVB for 
a A universe. Our best estimate is the modal 
value of J vo (filled red circle); the biased 'com- 
bined value' (open square) as well as the sim- 
ilarly obtained value from Paper I (open cir- 
cle) are shown for comparison. Also shown 
ar e the most recent evol ving UVB model 
by lHaard t & Maday d200 lh (cont inuous green 
line) and the determination by Bolt on et al] 
(2005). The horizontal bars indicate the lower 
and upper quartile of the quasar redshifts. 



Figs. QT| and [12] As said above, the cosmological model em- 
ployed does have an effect on the UVB result. FigurefTTIcollects 
literature measurements that were performed for an Einstein- 
de Sitter model. Mos t of t hem agree poorly with the UVB model 
by lHaardt & Madau (1996) (which was computed for the same 
cosmological model), in the sense that the measurements are sys- 
tematically higher. 

Figure [T2] puts our new determination of J Vo into con- 
text. It is remarkable that our modal value is almost exactly 
on the predicted curve based on the newer UVB model by 
lHaardt & Mada u (2001). Their computation was based on as- 
suming a combined contribution of QSOs and star-forming 
galaxies to the UV background, now performed for a A uni- 
verse. It is also fully consistent with the determination of the 
UVB photoionisation rate by B olton et al] (2005) obtained by 
matching the observed Ly forest transmission to cosmological 
simulations. It is equally evident that our 'combined value' is 
too high, as is our similarly obtained best-fit value in Paper I, 

We summarise this section by stating that the distribution 
of proximity effect strengths as determined in individual quasar 
spectra is largely consistent with a purely Poissonian random 
process. We thus understand why the PESD is asymmetric, and 
why previous measurements based on averaging sample proper- 
ties were bound to overestimate the UVB background. So far we 
have identified the modal value of the PESD as a largely unbi- 
ased estimator of the UVB. In the next section we will improve 
on this estimator by proposing a hybrid approach that also takes 
physical overdensities into account. 



8. The role of overdensities around quasars 

8.1. Quantifying overdensities 

We have demonstrated above that much of the disagreement be- 
tween proximity effect and other measurements of the UVB is 
due to the asymmetric shape of the PESD, even for the idealised 
case of purely Poissonian variance between sight lines. However, 
this does not imply that other effects can be neglected altogether. 
The most suspicious additional bias in this context is the de- 
gree of typical H° overdensity within a few Mpc around quasars. 
Obviously, if a quasar environment is overdense and thus more 
likely to show high column density absorption than the general 
Lyman forest, the proxim ity effect will appear to be weakened 
dLoeb & Eisensteinlll995l) . 

Th is is sue has b een recently addressed by Rollinde et al.l 
(2005) and Guimaraes et al. (2007) using both observations and 
numerical simulations. Their basic approach consisted of a com- 
parison of the cumulative optical depth probability distributions 




_J I I l I I L_ 

10 20 30 

Proper Distance [Mpc] 

Fig. 13. Average overdensity degree S as function of proper dis- 
tance for the complete sample of quasars (solid line) and in a 
subsample with 3 consistent with no sign of overdensities within 
3 Mpc from the quasar (dotted line). The two horizontal lines 
mark the ±l<x scatter expected from our simulation in the case 
of no overdense environment. 



at difference distances to their quasars. Close to the quasars, that 
distribution deviates from the one for the general Lyman forest. 
Assuming that the UVB photoionisation rate is well constrained 
from the cosmic mean H° opacity and accounting for the ex- 
pected proximity effect signature based on the known quasar 
luminosities, they concluded from the discrepancy between the 
measured and predicted distributions that quasars reside in phys- 
ical overdensities of a factor of a few (averaged over ~ 2.5h~ l 
proper Mpc). The amount of inferred overdensity depends, as 
one would expect, on the adopted value of the general UVB pho- 
toionisation rate. 

Here we approach the same problem from a different an- 
gle. We also assume that the mean UVB photoionisation rate, 
or the mean intensity J Vo , can be measured. We adopt the modal 
value of the PESD estimated in Sect. 17.31 which we demon- 
strated above to be in excellent agreement with other methods 
of estimating the UVB. We then again consider each individual 
quasar in our sample in turn, aiming at measuring the distribu- 
tion of (over)density properties. For the present paper we are not 
interested in estimating physical overdensities, but only in iden- 
tifying the quasars with strongly overdense environments. We 
therefore adopted a pragmatic definition of 'density' that simply 
involves the absorber optical depth within a certain filter length 
as a proxy. We computed this 'overdensity degree' S in the fol- 
lowing way: 

1. We reconstructed the optical depth profile T*(z), removing 
the radiative influence of the quasar by multiplying the op- 
tical depth t(z) in the Lya forest by 1 + u>(z). For the UVB 
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intensity we used the modal value of the PESD, log J Vg - 
-21.51. Despite the high S/N of our spectra, this procedure 
required particular attention for transmission points falling 
below zero and above unity due to noise and continuum 
uncertainties. The negative points belong to saturated lines 
which will become even more saturated after the inverse cor- 
rection for the proximity effect; such points were left uncor- 
rected. Pixels with transmission values T > 1 were also dis- 
regarded in the correction in order to prevent numerical prob- 
lems or an artificially increased S/N level. Both cases apply 
only to a small number of pixels, and their in- or exclusion 
does not affect the results. 

2. From the corrected t*(z) we computed the effective optical 
depth in bins along the line of sight and divided it by the ex- 
pected values at the appropriate values of z (given by eq.[T|i. 
This procedure had to be carried out for each object sepa- 
rately. We define this ratio of effective optical depths as the 
overdensity degree 3. We performed this calculation for dif- 
ferent bin sizes, corresponding to increments of 2, 3, 5 and 
8 proper Mpc. Qualitatively, the results are the same, with a 
bin size of 3 Mpc showing the clearest trends. We only quote 
results for that bin size in the following. 

3. We then merged all lines of sight, resulting in 40 estimates of 
H per distance bin. In each bin we estimated the mean and the 
standard deviation of S. We used our Monte-Carlo simulated 
spectra to reproduce our QSO sample and thereby estimated 
the amount of variance in 5 attributed to pure Poisson noise. 

8.2. Overdensity distribution 

The dependence of the average 5 as a function of distance is 
presented in Fig.[13](solid line). At large distances (> 5 Mpc), S 
fluctuates around unity as predicted by perfect Poissonian noise. 
Only in the innermost bin for ;£ 3 Mpc does the mean value 
of 3 increase towards an overdensity degree of a factor of 2 
(in units of optical depth). So far this can be seen as support- 
ing t he notion of quasars typ ically residing in overdense regions 
(e.g. lD'Odorico et al.l2008l) . However, in the same panel we also 
show the average S if the 10 objects (25 % of the sample) with 
the highest individual overdensities are removed (see below for 
details of this deselection). For all bins beyond ~ 5 Mpc, the run 
of 3 with distance is statistically indistinguishable for the two 
samples. Only for the nearest two bins the two profiles deviate, 
in the sense that the dotted profile (based on 75 % of the sample) 
is fully consistent with no overdensities at all. 

Figure [14] shows the individually measured 'overdensity de- 
grees' within the innermost 3 Mpc bin as a function of quasar 
luminosity at the Lyman limit, quasar redshift, and proximity 
effect strength log a (cf. Sect. 17. Il l, respectively. This diagram 
reveals that the corrected effective optical depths for individual 
quasars range from close to zero to up to 6 times larger than in 
the mean Lyo- forest. The horizontal dashed lines again indicate 
the amount of scatter (+l<x) expected for pure Poissonian vari- 
ance within the same physical scale around each of the QSOs. 

Panel [a] shows that there is no systematic tendency of 3 to 
vary with the quasar Lyman limit luminosity. The spread appears 
to be somewhat larger at high luminosities, which may reflect the 
expected trend of luminous quasars to reside in more massive 
environments. But there are also several high-L objects with 3 
values around unity. 

Regarding the redshift dependence depicted in Panel [b] of 
Fig. [14] no significant trend can be seen here either. There may 
be a deficit of high overdensities for z > 3, but this could equally 
be an effect of small number statistics. 



However, panel [c] of Fig. [14]reveals some dependence be- 
tween 3 and proximity effect strength log(a). The four QSOs 
with 3 > 3 are among the six objects with the weakest proxim- 
ity effect (highest values of log a). A quantitative test using the 
standard linear correlation coefficient r shows that log 3 is in- 
deed correlated with log a, r — 0.6 (with a probability of < 1 % 
of no correlation), but that this trend is strongly driven by the 
few points with 3 > 3. Without these points, the correlation co- 
efficient reduces to r — 0.4, and there is a 3 % probability of no 
intrinsic correlation. 



8.3. Effects of overdensities on the proximity effect strength 
distribution 

We now investigate how the presence of some fraction of the 
QSOs residing in dense environments changes the properties 
of the PESD. We generated a new sample of synthetic spec- 
tra at z - 2, 3 and 4, respectively, at a fixed luminosity of 
log(L Vo /erg s _1 Hz -1 ) = 31.5, with the difference that we now 
required that our sight lines show excess absorption near the 
emission redshift. We did not assume any particular radial distri- 
bution for the overdensity profile, but simply continued to popu- 
late the spectrum within 3 Mpc with lines until the effective op- 
tical depth reached a given threshold. We constructed two sam- 
ples, for overdensities of 3 = 2 and 4, respectively, to approx- 
imately mimic our observational results (500 spectra for every 
H). 

These simulations show that if all quasars had the same en- 
hanced expectation value (3), the shape of the PESD would 
not be greatly affected for all studied redshifts. The main effect 
would be a global shift of the PESD towards higher log a values, 
with the shift increasing as (3) becomes larger. This is shown in 
the top panel of Fig. [15] where we plotted the PESD for three 
expectation values of (3) = 1,2, and 4, respectively. Already 
for an average enhancement of (3) = 2, the peak of the PESD is 
shifted by ~ 0.6 dex. 

It follows that if quasar environments are systematically 
overdense by some uniform factor, we would be unable to tell 
this from our data alone: Our empirical determination of 3 de- 
pends on assuming the correct global J Vo . If the mode of the 
PESD is biased by some factor, we would underestimate the 3 
values of the individual quasars by the same factor, effectively 
renormalising the observed 3 scale to an expectation value of 
unity. Of course, this is nothing but yet another manifestation of 
the well-known degeneracy between the UVB and overdensities 
around quasars. 

However, such a simple picture of all quasars having the 
same density enhancement factor would be highly unrealistic. 
If quasars reside in overdensities, the enhancement will have a 
distribution stretching over at least a factor of few. Because the 
shift of the PESD depends on (3), this will lead to a broadening 
of the PESD by an amount depending on the physical spread of 
overdensities. Notice that this spread will come on top of the in- 
evitable scatter due to Poissonian variance. As an example toy 
model, we show in the bottom panel of Fig. [15] the modified 
PESD for an assumed physical rms scatter in (3) of 0.25 dex. 
The predicted distribution is considerably different; it is much 
broader and more box-shaped, and certainly much less in agree- 
ment with the observed PESD than the one for (3) = 1 . While 
the assumption of a scatter of 0.25 dex is entirely ad-hoc, the ex- 
ample shows that the PESD reacts quite sensitively, and a very 
small physical dispersion around the expectation value of 3 is re- 
quired to make observed and predicted PESD consistent. This is 
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Fig. 14. Dependence of the overdensity degree 
on quasar luminosity (panel [a]), redshift (panel 
[b]), and on the proximity effect strength (panel 
[c]). The uncertainties relative to each mea- 
surements are represented by the solid cross 
in the respective panel. The solid line in the 
right-hand panels shows the least-square linear 
fit to the data. In each panel the dashed hori- 
zontal lines give an estimate of the amount of 
Poissonian shot noise in the simulations of the 
forest for Rq = 3 Mpc from the emission red- 
shift, as ± lcr envelopes around the expected T cff 
in the case of no overdensity (S = 1). 



naturally obtained only if the expectation value for most quasars 
is close to (H) w 1. 

These considerations strongly support the notion that there 
is no strong systematic overdensity bias for the proximity effect. 
While the excellent agreement between our modal estimate and 
other ways of determining the UVB intensity (Fig.[T2l> is already 
highly suggestive, we cannot of course use this agreement both 
to justify our method and regard it as an indepenent measure- 
ment of the UVB. The comparison of expected and observed 
PESD shapes adds independent information from the distribu- 
tion properties and breaks the UVB-overdensity degeneracy. 

Clearly some fraction of objects sits in overdense regions. 
This, however, only produces a tail to the PESD by adding some 
high values of log a. A comparison of Fig. fl4b with Fig. \TU\ 
shows that the objects with strong overdensities are exactly those 
lying outside the prediction for the simple Poissonian model. 

We note in passing that there is no reason to interpret the few 
quasars showing an extremely strong proximity effect as sitting 
in 'underdensities'. The three objects with the lowest log a val- 
ues have a mean H very close to unity (see Fig. fl4b). and only 
one object is located outside of the +2<x envelope of 3 expected 
for pure Poissonian fluctuations around the mean density. 

8.4. A hybrid method of estimating the UV background 

In the following we adopt the notion that only a relatively small 
fraction of at most ~ 25 % of our quasars is affected by signifi- 
cant overdensities. If this is true, then for a completely unbiased 
estimation of the UVB we need to: (i) remove the quasars with 
biased environments; (ii) correct for the asymmetry bias in the 
proximity effect strength distribution. 

In order to conduct the first step we had to identify outliers in 
the 3 distribution. However, recall that 3 is based on the assump- 
tion that we already know the UVB background. As an initial 
guess we adopted the modal value from the PESD, from which 
we then could compute 3 for all quasars. There is no obvious 
cutoff, and many quasars have 3 values that are consistent with 
weak overdensities. We decided to make a conservative cut in 
the sense that we would rather avoid too many even mildly over- 
dense objects. We set the threshold at +lcr (predicted scatter for 
Poissonian variance), implying that quasars with 5 > 3o = 1.8 
would be excluded from the analysis. This was the case for 10 
objects, or 25 % of the sample. 

We then constructed the PESD based on the remaining 30 
objects. The modal value remains unchanged, but the uncertainty 
obviously increases (0.2 rather than 0.15 dex). The fact that the 
mode of the PESD is robust against the inclusion or exclusion of 
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Fig. 15. Top panel: Expected PESD computed from Monte-Carlo 
simulations for different expectation values of the overdensity 
degree (3 = 1, 2, 4, respectively). The main effect is a substan- 
tial shift towards an on average weaker proximity effect. Bottom 
panel: Comparison of the observed PESD and the expectation 
for an assumed Gaussian distribution of overdensities (see text 
for details). 



25 % of the sample is certainly encouraging. It is also clear that it 
would not be possible to use a much smaller fraction of objects, 
as the uncertainties of estimating the mode would rapidly go up. 
Next, we determined the systematic offset of the 'combined 
sample averaging' estimator (used in Sect. [6]) due to the asymme- 
try of the PESD. We proceeded as follows: We generated mock 
quasar samples from the Monte Carlo simulated spectra, assum- 
ing no systematic overdensity bias, with the same redshift and 
luminosity distributions as the observed sample. We removed 
those objects showing apparent overdensities (occurring because 
of statistical noise) and determined the best-fit UVB value using 
the standard sample combination method as described in Sect. [6] 
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Table 4. Summary of our UV background measurements and 
employed methods, for the sample median redshift z = 2.73'. 



Method 



log/v 



fit to combined sample 

modeofPESD 

mean of individual log a 

fit to combined subsample (H < 1.8) 

fit to combined subsample (S < 1.8,corrected) 



-21 10 +014 

z.i.iu 022 

-21.51 ± 0.15 

-21.24 ±0.17 
-21.19!°;" 
-21.46JU 



f: The two boldfaced rows represent the unbiased estimates. 



Repeating this step 500 times, we averaged over the differences 
to the input UVB, obtaining a mean offset of A log a = 0.27 dex. 

Finally, we conducted the same procedure for the observed 
sample with S < 1.8, performing a least-squares fit of Eq. [7] 
to the data and correcting the resulting value by the above offset. 
The inferred value is log J Va — -21 .46 *l! 2i> which we consider as 
the best and most robust estimate of the global UV background 
intensity for our sample. 

In order to find out how much the method depends on the 
adopted criterion to eliminiate outliers, we repeated the de- 
scribed procedure once more, but now setting the threshold at 
+2<x, corresponding to So = 3.1. This implies that only the 
four objects with the highest S values were excluded from our 
sample. We redetermined the mean offset, which remained un- 
changed. The least-squares fit of Eq.|7]to the data, corrected for 
the relative offset, yields again a value of log/ Vo = — 21.49* > 2j, 
demonstrating that our hybrid method is highly robust and quite 
insensitive to the outlier criterion. 

Determining the UVB intensity using this hybrid method has 
one important advantage over the modal PESD estimator: It de- 
pends less critically on the sample size. The mode is a robust 
statistical quantity only if the histogram from which it is esti- 
mated is reasonably well defined. In the next section we will 
split the sample into subsets to investigate the redshift evolution 
of the UVB. It will be seen that the PESD of such subsamples 
can become rather broad, inhibiting any confident mode estima- 
tion. The hybrid technique, on the other hand, involves straight- 
forward averaging and therefore also works for smaller samples. 

Table [4] summarises all our different methods of estimating 
the UVB intensity and the resulting values. 



9. The redshift evolution of the UV background 

The high S/N of our data and the size and redshift range of the 
sample prompted us to explore whether we could split the sam- 
ple into subsets of different redshifts and still get meaningful 
constraints on the UVB. 

As a first attempt we divided the sample into two subsets 
with z < 3 and z > 3. For each subset we constructed the 
PESD separately, shown in Fig. [16] The distributions look sub- 
stantially different from each other. The PESD of the lower red- 
shift subset is very broad, and no clear peak can be recognised. 
On the other hand, the high redshift PESD is significantly nar- 
rower and displays a well-defined maximum. The overall be- 
haviour is qualitatively consistent with the predictions of Fig. [9] 
based on our Monte Carlo simulations, where we found that 
the widths of the PESD should decrease as redshift increases 
(Sect. 17.2b . The modal value obtained from the high redshift 
sample is log/ Vo =* -21.6, slightly lower than the overall best 
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Fig. 16. Observed PESD for our sample of quasars divided into 
two redshift intervals. The shapes of the two PESDs differ sub- 
stantially from each other as predicted in Sect. 17.21 

Table 5. UV background intensity as function of redshift for the 
set of quasars that show overdensity degree 3 < 1 .8 as plotted in 
Fig. El 
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0.20 
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estimate. In the lower redshift subset, even a rough guess of the 
distribution mode is impossible. 

A more powerful way of estimating the UVB intensity is the 
hybrid method described in the previous subsection. We now 
employed this method to investigate the redshift evolution of 
the UVB. After merging all quasar spectra in the same way as 
for measuring the evolution of the Lyor effective optical depth 
(Sect.|4|i we sampled the Lyo- forest in redshift bins of Az = 0.2. 
We used only the forest in the redshift range 2 ^ z ^ 4 in order 
not to be affected by small number statistics. For every bin we 
fitted Eq. [7] to the data and obtained a preliminary estimate of 
J Vo . These values are still systematically high, both as a result of 
the PESD asymmetry and because of the influence of overdense 
lines of sight. In particular, the redshift ranges at z ~ 2.2 and at 
z ~ 2.9 are heavily affected by the latter effect, as at these red- 
shifts we find the majority of objects with a strongly overdense 
environment (cf. Fig.[T4l. In such narrow redshift bins, the val- 
ues of the UVB are extremely sensitive to locally enhanced ab- 
sorption, causing deviations of up to 1.3 dex. 

We now followed the same recipe as in Sect. 18.41 above: We 
removed from the sample those objects with S > 1.8 within the 
innermost 3 Mpc. We then applied the combined average estima- 
tor for each redshift interval and applied the PESD asymmetry 
bias determined from the simulations. We obtained in total eight 
values of J Vo , for eight different redshift bins as listed in Table[5] 
These result are presented as black points in Fig. [17j where the 
horizontal bars indicate the redshift interval and the vertical bars 
are the statistical errors. 

The top panel of Fig. [17] shows that our measurements do 
suggest a certain evolution of the UVB intensity with redshift. 
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Fig. 17. Evolution of the mean intensity of 
the UV background with redshift from those 
quasars with overdensity degree S < 1.8 (see 
text for details). We estimated the UVB using 
the combined analysis of the proximity effect 
in Az = 0.2 intervals over the range 2 < z < 4. 
Top panel: log./ vo (z) in comparison to a con- 
stant evolutionary model (dashed) and a linear 
fit to the data (solid). Bottom panel: log J vn (z) in 
comparison to the model by Haardt & Madau 
( 200 1 ) and the more r ecent determinatio n of the 
UVB evolution from lBolton et alj J2005I) . The 
errors in the z direction represent the range used 
to measure the average UVB. 



Fitting a simple least-squares linear relation to the data points 
we get 



log J V0 (z) = (-0.20 + 0.14) z + (-21.0 + 0.4) . 



(8) 



This fit (depicted as the solid line in the top panel of Fig. ITTb 
yields residuals fully consistent with random errors. However, 
the slope is not very steep, and in view of the size of the error 
bars it is appropriate to ask whether evolution is actually de- 
manded by the data. For comparison we considered also the null 
hypothesis of no evolution, which is represented by the horizon- 
tal dashed line in Fig. ITTb . The quality of that model is some- 
what poorer, but a KS test gives still 10 % acceptance probabil- 
ity, which is at best a marginal rejection. We can therefore only 
tentatively claim to detect the UVB evolution within this red- 
shift interval. In a different take, we can confidently exclude a 
very steep redshift evolution, such as would be predicted from a 
UV background made predominantly of quasar light. 

How do these results compare with other works aimed at es- 
timating or predicting the UVB evolu tion at similar redshifts ? 
We first consider the prediction by lHaardt & Madaul ([2001). 
They constrained J Vfl (z) by integrating the contributions of the 
observed quasar and young star-forming galaxy populations, ac- 
counting also for intergalactic absorption and re-emission. Their 
predicted redshift evolution of the UVB intensity is depicted as 
the solid green line in the lower panel of Fig. [TTT i. The agree- 
ment with our data points could hardly be better; in particular, 
the shallow slope is almost exactly reproduced. We roughly es- 
timate a slope of dJ/dz = -0.16 for the Haardt & Madau model 
at z ^ 2.2, which is extremely close to our best-fit value of -0.2. 
Nevertheless it should be emphasised that the galaxy contribu- 
tion to the UVB crucially depends on the poorly constrained es- 
cape fraction of Lyman continuum pho tons from galaxies (e.g. 
IShaplev et al.ll2006l:lGnedin et al]l2007l) . 

Recently, several studies calibrated the outcome of hydrody- 
namical IGM simulations through the measured Lya forest opac- 
ity to estimate the photoionisation history of intergalactic hy - 
drogen (e. g„ iBolton et al.ll2005t iFaucher-Giguere et al.l l2008a). 
These studies typically gave an approximatly constant UVB in- 
tensity wi thin the range 2 < z < 4. As an example we show the 
results of Bolt on et al] d2005l) by the crosses in the lower panel 
of Fig. ITTb . As stated above, a no-evolution scenario as found 



by these studies is also consistent wit h the errors, and ou r re- 
sults are also consistent with those of Bol ton et al] d2005l) and 
IFaucher-Giguere et all d2008al) . 

At any rate, our measurements confirm the prevailing as- 
sumption that quasars alone are unable to keep the IGM at a 
highly ionised state at redshifts larger than three. The integrated 
UV emissivity of AGN has a maximum very close t o z = 2 and 
drops by about an order o f magnitude towards z = 4 dWolf et alj 
120031: iHopkins et aT]|2007l) . whereas we find the UVB intensity 
to fall by only ~ 0.2 dex (2<x limit is 0.48 dex). This strength- 
ens the notion for a non-negligible contribution by star-forming 
galaxies to the UV background radiation field; their fractional 
contribution increases when going to higher redshifts. 

We can make a simple back-of-an-envelope estimate of the 
mixing ratio between quasars and stars by assuming that the ab- 
solute UV emissivity of star-forming galaxies is roughly con- 
stant with redshift between z = 2 and z - 4. Since the integrated 
quasar emissivity at z = 4 falls to ~ 10 % of its z - 2 value 
(Hop kins et alJ l2007). and using our best-fit measurement of the 
overall UV background evolution (adopting a factor 0.4 between 
z — 2 and z = 4), we obtain that the H° photoionisation rate at 
z — 2 is dominated by quasars by a factor of ~ 2 over star form- 
ing galaxies. At z - 4, galaxies would then dominate by a factor 
of 5 over quasars. Any change towards making the total UVB 
evolution more constant with redshift would increase the frac- 
tion of starlight in the UVB. 



10. Conclusions 

We have analysed the largest sample of high-resolution quasar 
spectra presented in a single study to date. We demonstrated 
that the line-of-sight proximity effect is a universal phenomenon 
that can be found in the spectrum of essentially every individual 
high-redshift quasar. While in Paper I we arrived at the same 
conclusion using low-resolution spectra, we now can signifi- 
cantly reinforce this claim. In particular, continuum placing un- 
certainties, which were a bit of an issue in Paper I, play abso- 
lutely no role now, given the high spectral resolution and high 
S/N data exploited in this paper. 

Our study rehabilitates the proximity effect as a tool to in- 
vestigate the intensity at 1 Ryd (more accurately: the H° pho- 



16 



Aldo Dall' Aglio et al.: An unbiased measurement of the UV background 



toionisation rate) of the cosmic ultraviolet background. Previous 
investigations using the proximity effect nearly always produced 
UVB estimates that were suspiciously high and indeed at vari- 
ance with other means to estimate or predict the UVB. It has 
been suggested in the literature that quasars typically reside in 
denser than average large-scale environments, and that therefore 
excess absorption biases the proximity effect to appear too weak, 
resulting in an overestimated UVB. We argue that this is not the 
main reason for the discrepancies between the proximity effect 
and other methods. 

The actually measured strength of the proximity effect in a 
single quasar line of sight depends on the UVB, but also on the 
number of absorption lines present in the 'proximity effect zone' . 
That number is generally small, and to first approximation the 
presence or absence of a line at a given redshift can be described 
as a Poissonian random process. We have demonstrated that the 
distribution of the resulting 'proximity effect strength' parameter 
(which directly relates to the UVB) is significantly skewed, even 
without invoking any physical overdensities. Any direct averag- 
ing over a sample of sightlines will inevitably bias the resulting 
UVB. Only by looking at individual lines of sight separately can 
this effect be detected and removed. 

We proposed and used two different methods of estimating 
the UVB intensity in the presence of this bias. In the first method, 
the UVB is taken directly from the mode of the proximity effect 
strength distribution (PESD). This method is simple and robust 
against a small number of outliers; on the other hand it is limited 
to large samples and depends on the condition that the mode is 
not affected by the outliers. Our second method involves Monte 
Carlo simulations to calibrate the asymmetry bias of the PESD 
and then uses straightforward sample averaging, possibly com- 
bined with a prior rejection of outliers, and the result is then 
corrected for the bias. This 'hybrid' method is quite stable and 
works also for smaller samples; it is, however, more complicated 
to use and depends on a successful removal of outliers. 

Our best estimates of the UVB intensity using these two 
methods give very similar results. The modal estimate is 
log/ Vo = -21.51 +0.15, and the hybrid estimator gives log7 Vo = 
— 21.46*?2p which is statistically indistinguishable. This value is 
in excellent agreement with other methods to estimate or predict 
the UVB. 

If the UV background is known, the data used for the prox- 
imity effect can also be employed to reconstruct the absorption 
pattern without the radiative influence of the quasar. Doing this 
for our sample of 40 quasars we found that only 10 % of them 
showed very significant excess absorption (by more than a fac- 
tor of ~ 3) while most are distributed in a way more or less 
consistent with Poissonian fluctuations around the cosmic mean 
absorption expected at these redshifts. Given the widespread no- 
tion of quasars residing in massive galaxies, which in turn should 
sit in massive haloes with significantly clustered environments, 
this sounds surprising. We have no intention of questioning that 
picture, and we stress that our measurements constrain exclu- 
sively the neutral hydrogen distribution averaged on scales of 
~ 3 proper Mpc towards the quasar. 

Nevertheless, our results may bear some relevance to the 
question of what are the typical halo masses for quasars. Most 
of the QSOs in our sample are optically selected and therefore 
presumably radio-quiet, which could mean t hat their haloes are 
not ex ceptionally massive. In a recent paper, Mandelb aum et al.1 
(2008) estimated halo masses of AGN in the Sloan survey 
from clustering and galaxy-galaxy lensing, finding that opti- 
cally selected AGN follow the same relation between stellar 
and halo mass as normal galaxies, whereas radio-loud AGN 



have much higher halo masses. (Incidentally, the outstanding ob- 
ject in our sample in terms of overdensity is the radio quasar 
PKS 0237-233; but the next-ranked objects are all optically se- 
lected.) 

Our argument against significant overdensities of quasars 
and in favour of the applicability of the proximity effect to mea- 
sure the UV background gains weight by the excellent agree- 
ment between our estimates of the UVB intensity and those 
obtained by completely different methods. This notion is sup- 
ported independently by considering the shape of the PESD. 
The observed distribution width clearly favours average densi- 
ties close to unity; if significant overdensities were involved, 
a much broader distribution would be expected than the one 
observed. This additional constraint breaks the degeneracy be- 
tween UV background and overdensities that has haunted the 
field for so long. 

Finally, we also attempted to constrain the redshift evolu- 
tion of the UVB intensity. Although the results are still quite 
uncertain, we could for the first time from a single quasar sam- 
ple derive useful limits on the amount of evolution. We can 
rule out at high significance that quasar light dominates the 
UVB at redshifts z ^ 4. Our best fit suggests a mild decrease 
in the UVB intensity towards higher redshifts, and the derived 
slope is in astonis hingly good agreement with the predictions by 
lHaardt & Madau (2001). Ne vertheless, an approximately con- 
stant UVB as found by Bol ton et alj d2005l) and others is also 
formally consistent with our data. 

We have shown that the proximity effect holds the potential 
to derive important cosmological quantities. While our sample 
is large in comparison to those of previous studies using high- 
resolution spectra, it still suffers in several aspects from small 
number statistics. As the public archives are growing, substan- 
tial progress can be expected from applying the proximity effect 
analysis to further spectra, in particular at higher redshift. 
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Appendix A: Proximity effect on individual lines of sight 
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Fig. A.l. The proximity effect signatures in individual lines of sight. Each panel shows the normalised optical depth £ versus to, 
binned in steps of A log a> = 1, with the best-fit model of the combined analysis superimposed as dotted red lines. The solid lines 
delineate the best fit to each individual QSO as described in the text. 
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Fig. A.l. Continued 



